Exploiting Non-deterministic Analysis in the Integration of Transient Solution Techniques for Markov Regenerative Processes
نویسندگان
چکیده
Transient analysis of Markov Regenerative Processes (MRPs) can be performed through the solution of Markov renewal equations defined by global and local kernels, which respectively characterize the occurrence of regenerations and transient probabilities between them. To derive kernels from stochastic models (e.g., stochastic Petri nets), existing methods exclusively address the case where at most one generallydistributed timer is enabled in each state, or where regenerations occur in a bounded number of events. In this work, we analyze the state space of the underlying timed model to identify epochs between regenerations and apply distinct methods to each epoch depending on the satisfied conditions. For epochs not amenable to existing methods, we propose an adaptive approximation of kernel entries based on partial exploration of the state space, leveraging heuristics that permit to reduce the error on transient probabilities. The case study of a polling system with generallydistributed service times illustrates the effect of these heuristics and how the approach extends the class of models that can be analyzed.
منابع مشابه
Accelerated decomposition techniques for large discounted Markov decision processes
Many hierarchical techniques to solve large Markov decision processes (MDPs) are based on the partition of the state space into strongly connected components (SCCs) that can be classified into some levels. In each level, smaller problems named restricted MDPs are solved, and then these partial solutions are combined to obtain the global solution. In this paper, we first propose a novel algorith...
متن کاملA Modeling Framework to Implement Preemption Policies in Non-Markovian SPNs
ÐPetri nets represent a useful tool for performance, dependability, and performability analysis of complex systems. Their modeling power can be increased even more if nonexponentially distributed events are considered. However, the inclusion of nonexponential distributions destroys the memoryless property and requires to specify how the marking process is conditioned upon its past history. In t...
متن کاملFast Value Iteration for Goal-Directed Markov Decision Processes
P lanning problems where effects of actions are non-deterministic can be modeled a8 Markov decision processes. Planning prob lems are usually goal-directed. This paper proposes several techniques for exploiting the goal-directedness to accelerate value itera tion, a standard algorithm for solving Markov decision processes. Empirical studies have shown that the techniques can bring about signi...
متن کاملMarkov Regenerative Stochastic Petri Nets
Stochastic Petri nets of various types (SPN, GSPN, ESPN, DSPN etc.) are recognized as useful modeling tools for analyzing the performance and reliability of systems. The analysis of such Petri nets proceeds by utilizing the underlying continuous-time stochastic processes continuous-time Markov chains for SPN and GSPN, semi-Markov processes for a subset of ESPNs and Markov regenerative processes...
متن کاملDiscrete Deterministic and Stochastic Petri
Petri nets augmented with timing speciications gained a wide acceptance in the area of performance and reliability evaluation of complex systems exhibiting concurrency, synchronization , and connicts. The state space of time-extended Petri nets is mapped onto its basic underlying stochastic process, which can be shown to be Markovian under the assumption of exponentially distributed ring times....
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2017